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(57) An electronic system for networking, switching 
or computing includes a backplane-based interconnec- 
tion system (100). The system includes a backplane 
(102) with a plurality of traces coupled to slots for re- 
ceiving circuit packs (1 04a-d). The backplane traces are 
configured to form point-to-point connections (106a-f) 



from one slot of the backplane to every other slot of the 
backplane. A hub circuit (110) is provided on each circuit 
pack for coupling the circuit pack to the point-to-point 
connections In the backplane. Circuit packs communi- 
cate via direct connections over the point-to-point con- 
nections or indirectly by sending traffic through point-to- 
point connections and hub circuits. 
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Description 

FIELD OF THE INVENTION 

[OOOi] The present Invention generally relates to 
large electronic systems, and in particular, to a telecom- 
munications switching system configuration that does 
not require a common switch fabric board. 

BACKGROUND OF THE INVENTION 

[0002J Large electronic systems, as used in comput- 
ing, data networking, and telecommunications elements 
often use a common backplane to provide high speed 
interconnection between several circuit boards, packs 
□r modules that plug into slots in the backplane. The 
backplane ia typically constructed of a multi-layer circuit 
board with conductive traces selectively routed to pro- 
vide the high-speed Interconnection. Connectors are 
provided on the backplane to couple circuit boards, 
packs, or modules which are held in place using a slot- 
ted chasis. The properties of these backplanes often 
have large influance over the capacity, performance, re- 
liability, cost, and scale properties of electronic systems. 
Some backplane designs provide high capacity, while 
others provide low cost. 

[0003] Currently, there are two predominant architoc- 
tures for providing backplane transport Infrastructures 
In high-speed telecommunications platforms, the bus 
and the fabric. These architectures both have limitations 
preventing the creation of a truly universal platform. 
[0004] Bus-based backplanes use a large set of par- 
allel signals, where each signal typically touches each 
slot and hence each board. This Interconnection 
scheme Is versatile and low cost, but imposes practical 
limits of a few billion bits per second on the maximum 
system throughput and also limits reliability.' The total 
throughput must also be shared among all boards on 
the backplane. Buses are typically used in smaller sys- 
tems that do not process large amounts of broadband 
traffic, or In systems with severe cost constraints. In par- 
ticular, bus- based backplanes have a very low cost of 
common elements, and therefore permit low system 
costs, especially where a system is not equipped with 
all of its circuit cards or modules Initially. 
[0005] Fabric based systems use a central high- 
speed fabric or hub to 6Wltch traffic between all modules. 
High-speed point-to-point connections (either parallel or 
serial) are routed over a cable or backplane between 
each module and the central fabric, in a star topology. 
The central fabric can provide the large bandwidths 
(over 1 trillion bits per second) needed to support high- 
speed computing or broadband communications. Unfor- 
tunately, because the full central fabric, with support for 
the maximum number of connections, must be installed 
before any modules can be Interconnected, the cost of 
such a system is often quite high, especially for partially 
equipped systems, where the large cost of the fabric is 



only amortized over a few modules. 
[0006] Computing and telecommunications needs 
are increasing tremendously. In particular, high band- 
width systems are considered a necessity for distributed 

5 computing, networking and telecommunications switch- 
ing. In light of the shortcomings of traditional bus-based 
backplane systems and central fabric-based systems, 
a need exists for a new paradigm in backplane-based 
systems That has the low cost of bus-based interconnect 

10 and the high capacity of central fabric-based intercon- 
nect. 

SUMMARY OF THE INVENTION 

is [0007] An electronic interconnection system in ac- 
cordance with the present invention includes a back- 
plane. The backplane includes a multi-layer circuit 
board with a plurality of connectorized slots for connect- 
ing to traces routed in the backplane. Using the connec- 
torized slots, circuit packs are coupled to the backplane 
and traces routed therein. To facilitate communication 
among the circuit packs coupled to the backplane, a hub 
circuit is provided on each circuit pack. In addition, point- 
to-point connections are provided from one slot in the 
backplane to each and every other slot in the backplane. 
The point-to-point connections are made using traces 
In the backplane. The hub circuits on each circuit pack 
couple to the point-to-point connections to facilitate con- 
trol and routing over the communication links formed by 
the point-to-point connections. 

[0008] The point-to-point connections formed in the 
backplane can be selectively routed between the slots, 
either physically or virtually, using the hub circuit to pro- 
vide different connection topologies, capacity, and reli- 
ability. In one configuration, each slot includes a point- 
to-point connection to all other slots, creating a full 
mesh. For example, for a backplane with sixteen slots 
for circuit boards, each board has fifteen point-to-point 
connections, each terminating at a different slot. This 
configuration provides a direct point-to-point connection 
from any one circuit pack or module to another circuit 
pack or module. In addition, communication between 
circuit packs is readily facilitated by communication 
through another circuit pack, if for example, a point-to- 
point connection is faulty or unavailable. A myriad of oth- 
er configurations are contemplated, Including a ring con- 
figuration, wherein adjacent slots have point-to-point 
connections and slots at opposite ends are joined via 
point-to-point connections to complete the ring. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] FIG, 1 1s a block diagram of a backplane-based 
Interconnection system Jn accordance with the present 
Invention. 

[0010] FIG. z Is a block diagram of a circuit board for 
use in the backplane-based Interconnection system 
shown in FIG. 1. 
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[001 1 ] FIG. 3 is a block diagram of a backplane-based 
interconnection system In accordance with the present 
invention wherein circuit boards are connected in a ring 
topology. 

[001 2] FIG. 4 is a block diagram of a backplane-based 
interconnection system in accordance with the present 
invention wherein circuit boards, are connected in a 
double star topology. 

[001 3] FIG. 5 is a block diagram of a backplane based 
interconnection system in accordance with the present 
Invention wherein multiple backplanes are connected 
using extender boards. 

BRIEF DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0014] FIG. 1 is a block diagram of a backplane inter- 
connection system 1 00 in accordance with the present 
invention. System . 100 Includes a backplane 102 and 
several circuit boards 104a-d, Backplane 102 provides 
intercommunication between circuit boards I04a-d. In 
particular, in accordance with the present invention, cir- 
cuit boards 104a-d each have point-to-point connec- 
tions 106a-f, which are used to route communications 
between circuit boards 104a-d. 
[0015] Backplane 102 has slots 108a-d, which pro- 
vide the interface for circuit packs 104a-d to couple to 
point-to-point connections 106a-f. Slots 108a-d are 
preferably connectors. Point-to-point connections 106a- 
f are formed by conductive traces formed in the multiple 
layers of backplane 102. In the preferred embodiment, 
the electrical properties of point-to-point connections 
I06a-f are implemented in accordance with the Infini- 
Band standard from the InfiniBand Trade Association, 
5440 SW Westgate Drive, Suite 217, Portland, OR 
97221 (www.sysio.org). In accordance with the Infini- 
Band electrical signaling specification, point-to-point 
connections 1 06a-f are 2.5 gigabits per second bi-direc- 
tional serial links over metallic conductors. As an alter- 
native to InfiniBand, any suitable substitute point-to- 
point link technology can be used. Most preferably, the 
traces forming point-to-point connections 106a-f are 
routed as signal pairs with the signal pairs routed adja- 
cent to each other on a single layer of the multi layer 
backplane, or on adjacent layers using Identical conduc- 
tor geometries. Most preferably, the layers adjacent to 
the layers carrying signal pairs are power or ground (that 
Is, signal ground). 

[0016] Each of the circuit boards 104a-d includes a 
hub circuit 110, a control/routing circuit 112 and an ap- 
plication circuit 114, Hub circuit 110 directly interfaces 
with point-to-point connections l06a-fto aliowthecircuit 
board to communicate over the point-to-point connec- 
tions. Control/routing circuit 112 implements the proto- 
col to control the routing over hub circuit 110 to the point- 
to-point connections 106a-f, Application circuit 114 in- 
cludes the circuitry necessary to implement a particular 
application and interface that application to the intercon- 
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nection system 1 00. For example, application circuit 1 1 4 
may implement an access or line interface, such as IS- 
DN or a feeder or trunk interface, such as T1 , T3 or 
OC12, Also, application circuit 114 may implement a 
5 processing resource, a digital signal processor or an- 
other resource. 

[0017] Although four circuits boards 104a-d are 
shown in FIG. 1 only the physical limitations of back- 
plane 1 02 and point-to-point connections 1 06a-f limit the 

10 number of circuit boards in an interconnection system 
in accordance with the present invention. In a preferred 
embodiment, 1 6 slots are provided in backplane 1 02 
and 240 point-to-point links are provided in backplane 
102 to provide a point-to-point, full duplex connection 

15 between all 16 slots in the backplane. 

[0018] FIG. 2 Is a block diagram showing circuit board 
104a in additional detail. Circuit board 104a includes a 
power circuit 116, hub circuit 110, control/routing circuit 
1 1 2 and application circuit 1 1 4. Power circuit 1 1 6 obtains 

20 power from backplane 102 and preferably conditions, 
convents and distributes that power to the components 
of circuit board 1 04a. Hub circuit 110, control/routing cir- 
cuit 1 1 2 end application circuit 1 1 4 implement the func- 
tions described above and further below. 

25 [001 9] Hub circuitn 0 preferably includes an NxN hub 
switch 120 and a routing table 122. Hub circuit 110 
serves as a distributed fabric switch element. This is In 
contrast to a central fabric switch used in telecommuni- 
cations systems In the prior art. NxN hub switch 1 20 cou- 

30 pies circuit board 104a to N minus one point-to-point 
connections in the backplane. For system 100 shown in 
FIG. 1 , N equals four. NxN hub switch 120 accepts and 
routes traffic to N links. Most preferably, one of the N 
links is circuit board 1 04a. The other links are the point 

35 to point connections to other hub circuits on circuit 
boards in other slots. NxN hub switch 1 20 has N minus 
one external links to point-to-point connections in back- 
plane 1 02 and one internal link 124 coupled to control/ 
routing circuit 112. Hub circuit 110 accepts traffic from 

40 the external links and routes it to the Internal Jink. Also, 
hub circuit 110 receives communications from circuit 
board 104a over internal link 124 and routes the com- 
munication to one or more appropriate external links. A 
further function of hub circuit 1 1 0 is to accept traffic from 

4s one of the external Jinks and route that traffic to some 
other of the external links without ever terminating that 
traffic on circuit board 104a. Routing table 122 is pref- 
erably a memory element that stores configuration in- 
formation and other data related to the point-to-point 

50 connections coupled to hub circuit 1 1 0. 

[0020] Control/routing circuit 112 provides some con- 
trol over the communications implemented by hub cir- 
cuit 1 1 0 and also interfaces application circuit 1 1 4 to hub 
circuit 110. Control/routing circuit 112 preferably in- 

bs eludes a control processor 1 ZS and a buffer 1 2B. Control 
processor 126 is preferably any microprocessor, mem- 
ory and necessary interface circuits. Control processor 
126 preferably implements a host adapter function that 
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provides low level control, buffering and priority man- 
agement in an InfiniBand network. Also, control proces- 
sor 126, which may be a network processor, preferably 
provides message and packet processing functions 
used for example in IP routing, asynchronous transfer 
mode (ATM) switching, and time slot interchange and 
protocol adaptation. Control processor 126 preferably 
translates and Interfaces traffic from hub circuit 110 to 
the buses used on application circuit 114. For example, 
application circuit 114 may Include one or more serial 
links, orbusses, including an InfiniBand serial link, a PCI 
bus, the UTOPIA bus (used for asynchronous transfer 
mode cells), and the H,1XQ bus (used for synchronous 
timeslots). Buffer 128 is preferably a large RAM that 
stores packets, messages and other payloads being 
processed by control processor 1 26. 
[0021] Application circuit 114 varies depending upon 
the application to be implemented. To facilitate flexibility 
and modularity, application circuit 114 includes several 
connectors 1 30 for receiving circuit board modules with 
varying functionality. Application circuit 114 Includes an 
application processor 132, RAM 134, and peripherals 
136. Application processor 132 uses RAM 134 and pe- 
ripherals 136 to implement an application, for example, 
an access or trunk interface or a feeder interface in a 
telecommunications network- Application processor 
132 is coupled to control processor 126 over bus 138. 
The preferred implementation for bus 1 38 Is a standard- 
ized bus such as PCI or a serial link such as InfiniBand. 
Oi her standard Interface buses 140, 142 are coupled to 
connectors 130 for application circuits utilizing those 
buses. Most preferably, connectors 130 are PCI mezza- 
nine card sockets. In addition to the other functions list- 
ed above, application processor 1 32 preferably includes 
functions for bandwidth management, call processing or 
a general-purpose server. 

[0022] FIG. 3 illustrates a backplane interconnection 
system 200 in accordance with the present invention. 
System 200 is similar in most respects to system 100 of 
FIG. 1 , as noted by the reuse of the same reference nu- 
merals used to designate components of system 10Q. 
However, the point-to-point connections 1 06g-j in back- 
plane 202 are configured differently from the point-to- 
point connections 106 a-f In backplane 102. Inparticular, 
the point-to-point connections 106g-j are selectively 
routed to form a ring configuration, in this ring configu- 
ration adjacent circuit boards have point-to-point con- 
nections to each other. For example, circuit board 1 04b 
has point-to-point connections 106g, 106h to adjacent 
circuit boards 104a and 1 04c. The two circuit boards at 
opposite ends of the system, circuit boards 104a and 
104d, are considered to be adjacent and have a point- 
to-point connection 1 06] between them. Although illus- 
trated In FIG. 3 as physical point-to-point connections, 
point-to-point connections 106g-jare alternatively virtu- 
al connections that may, for example, be implemented 
with direct or indirect connections, such as point-to- 
point connections I06a-f of FIG. 1. 
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[0023] FIG. 4 illustrates a backplane interconnection 
system 300 in accordance with the present invention. 
System 300 is similar in most respects to system 1 00 of 
FIG. 1 , as noted by the reuse of the same reference nu- 

3 merals used to designate components of system 1 00. 
However, the point-to-point connections 106k-o in back- 
plane 202 are routed differently from the point-to-point 
connections 106a-f In backplane 102, In particular, the 
point-to-point connections I06k-o are selectively routed 

10 to form a double star configuration. In this double star 
configuration, two of circuit boards 1 04a-d are arbitrarily 
chosen to be central circuit boards. In FIG. 4, circuit 
boards 104a, 104d are used as central circuit boards. 
The circuit boards that are not central circuit boards, in 

1& this case circuit boards 1 04 b, 1 04c, have point-to-point 
connections 1 06k, 1 06n, 1 061 » 1 06o to each of the cen- 
tral circuit boards, but no point-to-point connections to 
each other. The central circuit boards 104a, 104d have 
a point-to-point connection 10fim between them. The 

20 point-to-point connections 106k-o*may be virtual con- 
nections. An alternative to the double star configuration 
is a single star configuration, in which one circuit board 
is designated a central circuit board and every other cir- 
cuit board has a point-to-point connection to the central 

& circuit board, but no point-to-point connection to the oth- 
er circuit boards. 

[0024] FIG. 5 Illustrates a configuration of two back- 
plane interconnection systems in accordance with the 
present invention. One system js designated system 

30 500 and the other system is designated 500'. Both sys- 
tems 500, 500' include circuit boards 1 04a-c and back- 
planes 1 02 as shown and discussed above with respect 
to FIG. 1 . In accordance with the present invention, sys- 
tem 500 and system 500' are coupled together for com- 

35 munication between the circuit boards on each system 
by extender boards 504. Extender boards 504 are cou- 
" pled to backplanes 102 to extend the point-to-point con- 
nections in the backplanes 102. Preferably, extender 
boards 504 are passive circuit boards with traces routed 
therein to electrically extend the traces in the back- 
planes 1 02. One or more cables or connectors 506 are 
preferably used to electrically couple the systems 500, 
500* to each other. 

[0025] A myriad of systems may utilize the backplane 
4 5 interconnection system disclosed herein. One of many 
example systems is a universal gateway that provides 
conversions from one network to another network. In a 
universal gateway implemented using a backplane in- 
terconnection system In accordance with the invention, 
50 the application circuits may implement access circuits 
and digital signal processing circuits, For example, 
some application circuits may terminate access lines 
and long haul trunks. The interfaces utilized may include 
digital subscriber line (DSL) interfaces or OC12 trunk 
55 interfaces or other line or trunk interfaces. The digital 
signal processing circuits maybe used for compression, 
decompression, encryption and decryption. 
[0026] The present invention provides an intercon- 
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nection system that includes a backplane with connec- 
tori2ed slots and a plurality of point-to-point connections 
between the slots. The point-to-point connections are 
controlled by hub circuits coupled to each slot of the 
backplane. The point-to-point connections and the dis- 
tributed switching function provided by the hub circuit 
eliminate the need for a central fabric switching board. 
This advantageously reduces costs while not sacrificing 
bandwidth and capacity. 

[0027] Whereas the present Invention has been de- 
scribed with respect to specific embodiments thereof, It 
Will be understood that various changes and modifica- 
tions will be suggested to one skilled in the art and it is 
intended that the invention encompass such changes 
and modifications as fall within the scope of the append- 
ed claims. 



Claims 

1 . An electronic system comprising: 

a backplane including a multi-layer circuit 
board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 
rality of circuit packs is coupled to one slot of 
the plurality of slots; 

wherein each circuit pack of the plurality of cir- 
cuit packs includes a hub circuit to provide a 
plurality of hub circuits; 

wherein one hub circuit of the plurality of hub 
circuits has a point-to-point connection to an- 
other hub circuit of the plurality of hub circuits 
to facilitate communication between a first cir- 
cuit pack with the one hub circuit and a second 
circuit pack with the another hub circuit; and 
wherein the point-to-point connection is made 
using at least some of the plurality of traces. 

2. The system of claim 1 wherein the point-to-point 
connection comprises bi-directional serial links. 

3. The system of claim 2 wherein the system compris- 
es a telecommunications switching system. 

4. The system of claim 1 wherein at least one circuit 
pack of the plurality of circuit packs includes a con- 
trol/routing circuit that implements a protocol for 
communication between the one hub circuit and the 
another hub circuit. 

5. An electronic system comprising: 

a backplane including a multi-layer circuit 
board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 



a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 
rality of circuit packs is coupled to one slot of 
the plurality of slots; 
s wherein each circuit pack of the plurality of cir- 

cuit packs Includes a hub circuit to provide a 
plurality of hub circuits; 

a plurality of point-to-point connections be- 
tween the plurality of hub circuits to facilitate 
w communication between the plurality of hub cir- 

cuits; and 

wherein the plurality point-to-point connections 
are made using at least some of the plurality of 
traces. 

15 

6. The system of claim 5 wherein the plurality of point- 
to-point connections comprise bi-directional serial 
links, 

20 7. The system of claim 5 wherein each hub circuit Of 
the plurality of hub circuits has a first point-to-point 
connection to a first adjacent hub circuit and a sec- 
ond point-to-point connection to a second adjacent 
hub circuit. 

25 

8, The system of claim 5 wherein at least one circuit 
pack of the plurality of circuit packs includes a con- 
trol/routing circuit that implements a protocol for 
communication between the plurality of hub circuits. 

30 

9, The system of claim 5 wherein two circuit packs of 
the plurality of circuit packs are designated as cen- 
tral circuit packs and each hub circuit of the plurality 
of hub circuits that is not on the central circuit packs 

25 has a point-to-point connection to each of the cen- 
tral circuit packs. 

10, An electronic system comprising: 

40 a backplane including a multi-layer circuit 

board with a plurality of traces and a plurality of 
slots for coupling to the plurality of traces; 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of the plu- 

45 rality of circuit packs )s coupled to one slot of 

the plurality of slots; 

wherein each circuit pack of the plurality of cir- 
cuit packs includes a hub circuit to provide a 
plurality of hub circuits; 

so wherein each hub circuit of the plurality of hub 

circuits communicates with another hub circuit 
of the plurality of hub circuits via a direct point- 
to-point connection between the each hub cir- 
cuit and the another hub circuit or the each hub 

55 circuit communicates with the another hub cir- 

cuit via at least one hub circuit of the plurality 
of hub circuits and at least two point-to-point 
connections; and 
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wherein the direct point-to-point connection 
and the at least two point-to-point connections 
are made using at least some of the plurality of 
traces. 

11. The system of claim 1 0 wherein ths direct point-to- 
point connection and tho at least two point-to-point 
connections comprise bi-directional serial links. 



that some extended traces of the plurality of 
traces of the first backplane are connected to 
some extended traces of the plurality of traces 
of the second backplane. 

17. The system of claim 15 wherein the first extender 
circuit pack is coupled to the second extender circuit 
pack via a cable. 



12. The system of claim 10 wherein each circuit pack 10 
of the plurality of circuit packs includes a control/ 
routing circuit that Implements a protocol for com- 
munication between the plurality of hub circuits. 

13. The system of any of claims 4,8 or 12 wherein the is 
or each said circuit pack including a said control/ 
routing circuit further comprises an application cir- 
cuit coupled to the control/routing circuit. 

14. The system of claim 13 wherein the application clr- 
cuit comprises at least one of an access interface; 
line interface, trunk interface, processing resource 
and digital signal processor. 

15. The system of claim 13 wherein the application cir- 25 
cult includes a connector for receiving a module cir- 
cuit. 

16. An electronic system comprising: 

oo 

a first backplane and a second backplane, each 
of the first backplane and second backplane in- 
cluding a multi-layer circuit board with a plural- 
ity of traces and a plurality of slots for coupling 
to the plurality of traces; ss 
a plurality of circuit packs coupled to the plural- 
ity of slots such that one circuit pack of tho plu- 
rality of circuit pacts is coupled to one slot of 
the plurality of slots; 

wherein each circuit pack of the plurality of cir- 40 
cuit packs Includes a hub circuit to provide a 
plurality of hub circuits; 

a plurality of point-to-point connections be- 
. tween the plurality of hub circuits to facilitate 
communication between the plurality of hub cir- 45 
cuits; 

wherein the plurality point-to-point connections 
are made using at least some of the plurality of 
traces; 

a first extender circuit pack: coupled to the first so 
backplane to extend some extended traces of 
the plurality of traces of the first backplane; 
a second extender circuit pack coupled to the 
second backplane to extend some extended 
traces of the plurality of traces of the second 
backplane; and 

wherein the first extender circuit pack and the 
second extender circuit pack are coupled such 
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FIG. 2 
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FIG. 4 
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